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@ An apparatus for decoding an encoded digital 
video signal for the reproduction of an original video 
image signal comprises an image data partitioning 
circuit for dividing difference pixel values on the 
basis of the current macro block into four equal- 
sized current subblocks, motion compensation units 
and a formatter for providing predicted current 
macro block data, adders for providing the recon- 
structed current macro block signais by combining 
the predicted current macro block data and the 
difference pixel data. The motion compensation units 
have four memories for storing the reconstructed 
current macro block signals as the divided previous 
subblock data. 



FIG. 1 



50 



IOC 



VLD 



L10 



— 

L20 



INVERSE 

ZIGZAG 

SCANNER 



IQ 

ZE 



IDCT 



IMAGE DATA 
PARTiONING 
CIRCUIT 



500 



ADDER [ "^j l ADDER \ y 



400 



00 



120 



140 



160 



r 



180 

y 





210 


1 220 

1 — ^ 




230 


RFC 




FIFO 1 


FIFO 





RFC J 

JOC 



ADDER 



MOTION 
COMPEN 
-SATION 
UNIT 



MOTION 
CCMPEN 
-SATION 
UNIT 



U3 



LI 4 



530 



SECTION 

::oMPEN 

-SATION 
UNIT 



L24 



ADDER 



LI 5 



6301 



MOTION 
COMPEN 
-SATION 
UNIT 



L2f 



650 



LI 2'^' LI 



F ORMATTER 
/I Llil U5"l 



Rank Xerox {UK) Business Services 

•3. 10/3. 09/3. 3.dt 



EP 0 688 135 A2 



Field of the Invention 

The present invention relates to a video imag- 
ing system; and, more particularly, to an improved 
video image decoding apparatus for decompress- 
ing incoming compressed video image data in par- 
allel. 

Description of the Prior Art 

In various electronic/electrical applications such 
as high definition television and video telephone 
systems, an image signal may need be transmitted 
in a digitized form. When the image signal is 
expressed in a digitized form, there is bound to 
occur a substantial amount of digital data. Since, 
however, the available frequency bandwidth of a 
conventional transmission channel is limited, in or- 
der to transmit the image signal therethrough, the 
use of an image signal encoding apparatus be- 
comes necessary to compress the substantia! 
amounts of digital data. 

Accordingly, most image signal encoding ap- 
paratus employ various compression techniques(or 
coding methods) built on the idea of utilizing or 
reducing spatial and/or temporal redundancies in- 
herent in the input image signal. 

Among the various video compression tech- 
niques, the so-called hybrid coding technique, 
which combines temporal and spatial compression 
techniques together with a statistical coding tech- 
nique, is known to be most effective. 

Most hybrid coding techniques employ a mo- 
tion compensated DPCM(differential pulse code 
modulation), two-dimensional DCT(discrete cosine 
transform), quantization of DCT coefficients, and 
VLC(variable length coding). The motion compen- 
sated DPCM is a process of determining the move- 
ment of an object between a current frame and its 
previous frame, and predicting the current frame 
according to the motion flow of the object to pro- 
duce a differential signal representing the differ- 
ence between the current frame and its prediction. 
This method is described, for example, in Staffan 
Ericsson, "Fixed and Adaptive Predictors for Hy- 
brid Predictive/Transform Coding", IEEE Transac- 
tions on Communications . CQM-33 , No. 12- 
(December 1985); and in Ninomiya and Ohtsuka, 
"A Motion Compensated Interframe Coding 
Scheme for Television Pictures", IEEE Transac- 
tions on Communications , COM-30 , No. 1 (January 
1982). 

The two-dimensional DCT, which reduces or 
removes spatial redundancies between image data 
such as motion compensated DPCM data, converts 
a block of digital image data, for example, a block 
of 8 X 8 pixels, into a set of transform coefficient 
data. This technique is described in, e.g., Chen and 



Pratt, "Scene Adaptive Coder", IEEE Transactions 
on Communications , COM-32 , No. 3(March 1984). 
By processing such transform coefficient data with 
a quantizer, zigzag scanner and VLC circuit, the 

5 amount of data to be transmitted can be effectively 
compressed. 

Specifically, in the motion compensated 
DPCM, current frame data is predicted from pre- 
vious frame data based on an estimation of the 

w motion between the current and the previous 
frames. Such estimated motion may be described 
^ in terms of two dimensional motion vectors repre- 
senting the displacement of pixels between the 
previous and the current frames. 

15 In order to compress the image signals with 

the above mentioned technique, the use of a pro- 
cessor capable of carrying out a high speed pro- 
cessing becomes necessary, and this is usually 
achieved by employing a parallel processing tech- 

20 nique. Generally, in the image signal decoding 
apparatus having the parallel processing capability, 
one video image frame area is divided into a plural- 
ity of subframes, and image data within the video 
image frame area is processed on a subframe-by- 

25 subframe basis. 

On the other hand, to determine a motion vec- 
tor for a search block in the current frame, a 
similarity calculation is performed between the 
search block of the current frame and each of a 

30 plurality of equal-sized candidate blocks included 
in a generally larger search region within a pre- 
vious frame, wherein the size of the search block 
typically ranges between 8x8 and 32 x 32 pixels. 
Consequently, the search region containing a 

35 boundary portion of any subframe also includes a 
boundary portion of a neighboring subframe. Ac- 
cordingly, the motion estimation carried out by 
each processor requires a shared memory system 
with a multiple random access capability, resulting 

40 in an inefficient memory access. 

Summary of the Invention 

It is, therefore, a primary object of the present 
45 invention to provide an improved video image de- 
coding apparatus capable of carrying out a parallel 
processing by dividing a macro block into four 
subblocks, without having to use a shared memory 
system with a multiple random access capability. 
50 In accordance with the present invention, there 

is provided an apparatus for decoding an encoded 
digital video signal for the reproduction of an origi- 
nal video image signal, wherein the encoded digital 
video signal includes encoded frame difference sig- 
55 nals between the pixels in a current frame and the 
pixels in a previous frame, and encoded motion 
vectors, each of the current and the previous 
frames having a number of macro blocks and each 



2 



EP 0 688 135 A2 



of the motion vectors representing a spatial dis- 
placennent between a macro block in the current 
frame and a corresponding matching point in the 
previous frame, which comprises: means for divid- 
ing a previous macro block included in the pre- 
vious frame into four equal-sized previous sub- 
blocks; four memory means for storing the divided 
previous subblock data; means for decoding the 
encoded frame difference signals to thereby pro- 
vide difference pixel values on a current macro 
block by macro block basis; means for dividing the 
difference pixel values for the current macro block 
into four equal-sized current subblocks; four first-in 
first-out(FIFO) buffers for storing the divided cur- 
rent subblock data; means for addressing said four 
memory means to derive predicted current macro 
block data therefrom in response to the motion 
vector for said current macro block; and means for 
providing the reconstructed current macro block 
signal by combining the predicted current macro 
block data and the difference pixel data from the 
FIFO buffers. 

Brief Description of the Drawings 

The above and other objects and features of 
the present invention will become apparent from 
the following description of preferred embodiments 
given in conjunction with the accompanying draw- 
ings, in which: 

Fig. 1 is a block diagram of a video signal 
decoding apparatus in accordance with the 
present invention; 

Fig. 2 offers a block diagram illustrating one of 
the identical motion compensation units shown 
in Fig. 1 ; 

Fig. 3 presents a detailed block diagram illus- 
trating the address adjuster shown in Fig. 2; 
Fig. 4 describes an exemplary macro block 
which is divided into four equal-sized subblocks: 
Figs. 5A and 5B provide horizontal and vertical 
address representing a motion vector; 
Fig. 6A depicts an exemplary frame having 4 x 
3 macro-blocks; 

Fig. 68 represents an enlarged view of a given 
block shown in Fig. 6A; 

Fig. 7 illustrates four memory modules storing 
subblock data; and 

Figs, 8A and 88 constitute the tables for ex- 
plaining an adjustment of motion vector address. 

Detailed Description of the Preferred Embodiments 

The present invention provides for the commu- 
nication of high definition television(HDTV) signals 
from a transmitter location to a population of re- 
ceivers. At the transmitter of an "encoder" end of 
the communication link, digital video signals for 



successive frames of a television picture are en- 
coded through the use of various coding methods 
known in the art. The inventive decoding apparatus 
includes four image processing modules, each of 

5 which has a processor dedicated to the processing 
of video data from a particular subblock. 

Referring to Fig. 1, there is shown a block 
diagram of the inventive parallel decoding appara- 
tus, which comprises four image data processing 

10 modules 300 to 600. Each of the image data pro- 
cessing modules 300 to 600 has identical adders 
320 to 620 and motion compensation units 330 to 
630, each of the identical elements serving a same 
function. 

75 As shown in Fig. 1, a variable length encoded 

digital video signal received from an encoding 
apparatus(not shown) is inputted via a terminal 50 
to a variable length decoding(VLD) circuit 100. The 
encoded video signal includes a plurality of video 

20 frame data, each of said video frame data, occupy- 
ing a video image frame area, has variable length 
coded transform coefficients and motion vectors. 
The variable length coded transform, coefficients 
represent the difference data between a current 

25 frame and a previous frame, each of which has a 
same number of macro blocks. 

The VLD circuit 100 decodes the variable 
length coded transform coefficients and the motion 
vectors to send the transform coefficient data to an 

30 inverse zigzag scanner 120 and the motion vector 
data to each of the motion compensation units 330 
to 630, incorporated in the image data processing 
modules. The VLD circuit is basically a look-up 
table: that is, in the VLD circuit, a plurality of code 

35 sets is provided to define respective relationships 
between variable length codes and their run-length 
codes or motion vectors. 

Video image data is provided from the VLD 
circuit iOO to the inverse zigzag scanner 120 

40 through a line L20. In the inverse zigzag scanner 
120, the quantized DCT coefficients are recon- 
structed to provide an original block of quantized 
DCT coefficients. A block of quantized DCT coeffi- 
cients is converted into a set of DCT coefficients in 

45 an inverse quantizer(IQ) 140 and fed to an inverse 
discrete cosine transform(IDCT) circuit 160 which 
transforms the set of DCT coefficients into a frame 
difference signal between a block of the current 
frame and its corresponding block of the previous 

50 frame. The frame difference signal from the IDCT 
circuit 160 is then sent to an image data partition- 
ing circuit 180 for the division thereof. 

In accordance with the present invention, the 
image data partitioning circuit 180 divides the 

55 frame difference signal for a current macro block 
from the IDCT circuit 160 into four current sub- 
blocks having the size of 8 x 8 pixels and provides 
the divided four subblock data to first-in first-out- 
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(FIFO) buffers 210 to 240 for the temporary storage 
thereof, said four current subblocks forming the 
current macro block. Referring to Fig. 4, there is 
shown an exemplary macro block 10 having the 
size of 16 X 16 pixels which is divided into four 
equal-sized subblocks YO to Y3 having 8x8 pixels, 
each subblock having vertical and horizontal block 
numbers, That is. YO to Y3 have the vertical and 
horizontal block numbers (00), (01), (10) and (11), 
respectively. The frame difference signal for each 
of the subblocks YO to Y3 is stored in the FIFO 
buffers 210 to 240 shown in Fig. 1, respectively. 

In the meanwhile, the variable length decoded 
motion vector from the VLD circuit 100 is fed to 
each of the motion compensation units 330 to 630 
through a line L10. Each of the motion compensa- 
tion unite is dedicated to the processing of macro 
block data bounded by a subblock, and is substan- 
tially identical each other. The motion compensa- 
tion units extract reconstructed precious macro 
block signals on a subblock by subblock basis 
from the frame memory modules incorporated 
therein based on the motion vector and generate 
the reconstructed previous macro block signals 
onto lines L22 to L25 as first predicted current 
macro block signals, respectively. The first pre- 
dicted current macro block signals on lines L22 to 
L25 are provided to a formatter 650 and realigned 
to form second predicted current macro block sig- 
nals. The realigned second predicted current 
macro block signals are sent to the adders 320 to 
620 through lines LI 2 to LI 5, respectively. More 
detailed descriptions of the motion compensation 
units and the formatter will be provided hereinafter 
with reference to Figs. 2, 6A, 6B and 7. The sec- 
ond predicted current macro block signals on the 
lines LI 2 to LI 5 and the frame difference signals 
from the FIFO buffers 210 to 240 are summed up 
at the respective adders 320 to 620 to constitute a 
reconstructed current frame signal of a given sub- 
block and written onto each memory module in the 
motion compensation units 330 to 630; and trans- 
mitted to a display unit(not shown) through lines 
L32 to L35 for the display thereof. 

Referring now to Fig. 2. there is depicted a 
detailed block diagram illustrating one of the iden- 
tical motion compensation unite, i.e., the motion 
compensation unit 330 shown in Fig. 1. A motion 
vector is fed to an address generator 710 through 
the line L10, wherein the motion vector represents 
a spatial displacement between a macro block in 
the current frame and a corresponding matching 
point, i.e., a most similar block, in the previous 
frame. Specifically, the matching point for each of 
the macro blocks is searched in a search region 
within the previous frame, wherein the search re- 
gion is defined as a region of a predetermined area 
which encompasses the position of the correspond- 



ing macro block. 

At the address generator 710, the motion vec- 
tor on the line LIO is processed as well known in 
the art and a motion vector address having a 

5 horizontal and a vertical address components 
shown in Figs. 5A and 5B is generated to an 
address adjuster 720. 

As shown in Figs. 5A and 5B, the horizontal 
address consists of 13 bits, i.e., hO to h12 (h[12:0]). 

10 wherein bit hO represents half pixel information, bits 
hi to h3, a horizontal pixel position, bit h4, a 
horizontal block position, and bits h5 to hi 2, a 
macro block number. The vertical address is com- 
prised of 9 bits, i.e., vO to v8 (v[8:0]), wherein bit vO 

15 indicates half pixel information, bits v1 to v3,. a 
vertical line number, bit v4, a vertical block posi- 
tion, and bits v5 to v8, a vertical slice number. 

In a preferred embodiment of the present in- 
vention, the motion vector address for a macro 

20 block within the current frame indicates a left-top 
corner of a block within the previous frame having 
the same size as that of the macro block. Referring 
to Fig. 6, there is depicted an exemplary previous 
frame 20 having 4x3 macro blocks, wherein the 

25 previous frame 20 includes a block 25 having the 
size of 16 X 16 pixels, designated by a motion 
vector MV, 

As shown in Fig. 6A, the motion vector MV 
indicates the left-top corner of the block 25. The 

30 block 25 includes sections A1, CI within a first 
macro block MB1, sections 81, A2, D, C2 within a 
second macro block MB2, section A2 within a fifth 
macro block MBS and sections B2, A4 within a 
sixth macro block MB6, in the previous frame 20, 

35 wherein A1 belongs to subblock Y1 in MB1, B1 
belongs to YO in MB2, Cl belongs to Y3 in MB1 
and D belongs to Y2 in MB2; A2 belongs to sub- 
block Y1 in MB2 and C2 belongs to Y3 in MB2: A3 
belongs to Y1 in MBS and B2 belongs to YO in 

40 MB6; and A4 belongs to Y1 in MB6, as illustrated 
in Fig. 4. Fig. 6B shows an enlarged view of the 
given block 25 shown in Fig. 6A, which is divided 
into four equal-sized blocks 21 to 24 by a dotted 
line, each of which has four sub-sections belonging 

45 to different macro blocks in the previous frame. 
That is, block 21 includes four sub-sections A1, 
Br, Cr and D'; block 22 includes sections 81", 
A2, D" and C2'; block 23 includes sections Cl", 
D'*', A3 and B2'; and block 24 includes sections 

50 D"". C2", 82" and A4, wherein 81 ' and B1" form 
section 81; and 82' and 82" form section 82; CV 
and CI" form section Cl; and C2' and C2" form 
section C2; and D*. D". D"' and D"" form section 
D. 

55 In accordance with the present invention, each 

of the subblock data within the macro block is 
stored in each different memory module, which is 
incorporated in each of the corresponding motion 
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compensation units 330 to 630 shown in Fig. 1. 
Referring to Fig. 7, there are illustrated four mem- 
ory modules MO to M3, each of which stores sub- 
block data corresponding to each subblock of the 
macro blocks in the previous frame 20 That is, 
subblock data of subblocks YO to Y3 is stored in 
the memory modules MO to M3, respectively. For 
example, sections A1, A2, A3 and A4 belonging to 
the subblock Y1 of each of the macro blocks MB1, 
MB2, MBS and MB6 are stored in the memory 
module Ml; sections B1 and B2 contained in the 
subblock YO of each of the macro blocks MB2 and 
MB6, the memory module MO; sections C1 and C2 
included in the subblock Y3 of each of the macro 
blocks MB1 and MB2. the memory module M3: 
and section D contained the subblock Y2 of the 
macro block MB2, the memory module M2, as 
shown in Fig. 7. 

In the meantime, the motion vector address 
from the address generator 710 indicates an x- 
marked position of each of the memory modules 
MO to M3 shown in Fig. 7. In this case, even 
though it is possible to correctly indicate a block 22 
in the memory module M1, it is required to adjust 
the motion vector address for correctly designating 
blocks 21, 23 and 24 in the memory modules MO, 
M2 and M3. 

In accordance with the present invention, in 
order to the address block 21 in the memory 
module MO, the macro block number from the 
horizontal address shown Fig. 5A is incremented 
by "1" and the horizontal pixel position in the 
macro block is set to "0". Similarly, in case of the 
block 23 in the memory module M2, the macro 
block number is incremented by "1" and both the 
vertical line number from the vertical address 
shown in Fig. 5B and the horizontal pixel position 
from the horizontal address are sat to "0"; and in 
case of the block 24 in the memory module M3, 
the vertical line number from the vertical address is 
set to "0". 

Referring to Figs. 8A and 8B, there are pro- 
vided tables for explaining the adjustment process 
of the motion vector address. In the tables, BNO 
and BN1 represent a vertical and a horizontal sub- 
block numbers, respectively; v4 and h4 represent 
respective a vertical and a horizontal block posi- 
tions. The numerals in Fig. 8A represent whether 
the macro block numbed and the vertical slice 
number should be incremented by "1" or not: and 
the numerals in circles in Fig. 8B represent wheth- 
er the vertical and the horizontal pixel positions 
should be set to "0" or not. For example. If v4h4 is 
01 and BN0BN1 is 00, numerals 01 and 10 in 
circles in Figs. 8A and 88 represent that the macro 
block number should be incremented by "1" and 
the horizontal pixel position should be set to "0". 



Referring back to Fig. 2, the address adjuster 
720 adjusts the motion vector address from the 
address generator 710 using the vertical and the 
horizontal subblock numbers NO and N1, with the 

5 bit v4 indicating the vertical block position and bit 
h4 representing horizontal block position, and gen- 
erates the adjusted motion vector address to a 
memory module(MO) 730 (A more detailed descrip- 
tion of the address adjuster 720 will be provided 

10 hereinafter with reference to Fig. 3). 

The reconstructed subblock data in the mem- 
ory module 730 is retrieved in response to the 
adjusted motion vector address from the address 
adjuster 720 and provided to a buffer 740 for the 

15 storage thereof. And, the reconstructed current 
frame signal of a given subblock from the adder 
320 shown in Fig. 1 is written in the memory 
module 730. The buffer 750 temporarily stores the 
reconstructed subblock data corresponding to sec- 

20 tions B1 and B2 shown in Fig. 7 and provides them 
onto the line L22. Similarly, the motion compensa- 
tion units. 430 to 630 provide the reconstructed 
current subblock data corresponding to sections 
A1, A2, A3 and A4 in the block 22, section D in the 

25 block 23 and sections CI and C2 in the block 24 
shown in Fig. 7 to the lines L23 to L25, respec- 
tively. At the block formatter 650, subblock data 
from each of the motion compensation units is 
realigned as shown in Fig. 6B; and, then, predicted 

30 current subblock data corresponding to each of the 
blocks 21 to 24 is provided on the lines L12 to LI 5, 
as shown in Fig. 1 . 

Referring now to Fig. 3, there is provided a 
detailed block diagram illustrating the address ad- 

35 justor 720 shown in Fig. 2. 

As shown in Fig. 3, bit h[4] on a bus BUSI is 
applied to an AND gate 820 and an exclusive NOR 
gate 840 as their input. A vertical subblock number 
BNO is also supplied to the AND gate 820 Lhrough 

40 an inverter 830 and the exclusive NOR gate 840 as 
their another input. The AND gate 820 performs a 
logic AND operation for its two inputs and gen- 
erates a logic low or logic high signal to the in- 
crementor 810, wherein the output of the AND gate 

45 820 is a logic high only if its two inputs are logic 
high. The exclusive NOR gate 840 performs an 
exclusive NOR operation for its two inputs and 
generates a logic low or logic high signal to a 
multiplexer(MUX) 850, wherein the output of the 

50 exclusive NOR gate 840 is a logic high only if both 
of its two inputs are identical- 

The incrementor 810 increments the horizontal 
bits h[12:5] applied thereto by "1" if the AND gate 
820 generates a logic high signal; otherwise, it 

55 outputs the h[l2:5] directly to an address recon- 
structor 910. The MUX 850 outputs the horizontal 
bits h[3:1] applied thereto to the address recon- 
structor 910 if the exclusive NOR gate 840 gen- 
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erates a logic high signal; otherwise, it provides a 
logic low signal to the address reconstructor 910. 

In the meantime, bit v[4] on a bus BUS2 is 
applied to an AND gate 870 and an exclusive NOR 
gate 890 as their input. A horizontal subblock num- 
ber BN1 is also supplied to the AND gate 870 
through an inverter 880 and the exclusive NOR 
gate 890 as their another input. The AND gate 870 
performs the same operation as the AND gate 820 
for its two inputs and generates a logic low or logic 
high signal to an incrementor 860; and the exclu- 
sive NOR gate 890 performs the same function as 
the exclusive NOR gate 840 for its two inputs and 
generates a logic low or logic high signal to a MUX 
900. 

The incrementor 860 increments vertical bits v- 
[8:5] applied thereto by "1" if the AND gate 870 
generates a logic high signal; otherwise, it outputs 
the v[8:5] directly to the address reconstructor 910. 
The multiplexer 900 outputs the vertical hits v[3:1] 
applied thereto to the address reconstructor 910 if 
the exclusive NOR gate 890 generates a logic high 
signal; otherwise, it provides a logic low signal to 
the address reconstructor 910. The address recon- 
structor 910 generates adjusted address data to the 
memory module 730 for the access thereof. 

While the present invention has been de- 
scribed with respect to certain preferred embodi- 
ments only, other modifications and variations may 
be made without departing from the spirit and 
scope of the present invention as set forth in the 
following claims. 

Claims 

1. An apparatus for decoding an encoded digital 
video signal for the reproduction of an original 
video image signal, wherein the encoded digi- 
tal video signal includes encoded frame dif- 
ference signals between the pixels in a current 
frame and those in a previous frame and en- 
coded motion vectors, each of the current and 
the previous frames having a number of macro 
blocks and each of the motion vectors repre- 
senting a spatial displacement between a 
macro block in the current frame and a cor- 
responding matching point in the previous 
frame, which comprises: 

means for dividing a previous macro block 
included in the previous frame into four equal- 
sized previous subblocks; 

four memory means for storing the divided 
previous subblock data; 

means for decoding the encoded frame 
difference signals to thereby provide difference 
pixel values on the basis of a current macro 
block; 

means for dividing the difference pixel val- 



ues for the current macro block into four equal- 
sized current subblocks; 

four first-in first-out(FIFO) buffers for stor- 
ing the divided current subblock data; 
5 means for addressing said four memory 

means to derive predicted current macro block 
data therefrom in response to the motion vec- 
tor for said current macro block; and 

means for providing the reconstructed cur- 
10 rent macro block signal by combining the pre- 

dicted current macro block data and the dif- 
ference pixel data from the FIFO buffers. 

2. The apparatus of claim 1, wherein the address- 
75 ing means includes: 

means for generating a motion vector ad- 
dress having a horizontal and a vertical ad- 
dress components based on the motion vector, 
wherein the horizontal address has a macro 
20 block number and a horizontal block position 

and the vertical address has a vertical slice 
number and a vertical block position; and 

means for adjusting the motion vector ad- 
dress by incrementing the macro block num- 
25 ber and the vertical slice number by "1" and 

setting the horizontal and the vertical pixel 
positions to "0". 
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